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"*^ ■ Abstract 

OO . A celebrated financial application of convex duality theory gives an explicit relation 

between the following two quantities: 






(i) The optimal terminal wealth X*{T) := X^*{T) of the classical problem to maxi- 
mize the expected [/-utility of the terminal wealth Xyp(T) generated by admissible 
portfolios f{t); < t < T in a market with the risky asset price process modeled 
as a semimartingale 

(ii) The optimal scenario -^ of the dual problem to minimize the expected y-value 

of jp over a family of equivalent local martingale measures Q. Here V is the 

convex dual function of the concave function U. 

>• ! 
JI^ I In this paper we consider markets modeled by Ito-Levy processes, and in the first 

Tij- ' part we give a new proof of the above result in this setting, based on the maximum 

^^ . principle in stochastic control theory. An advantage with our approach is that it also 

gives an explicit relation between the optimal portfolio <p* and the optimal measure 
Q*, in terms of backward stochastic differential equations. 

^r^ • In the second part we present robust (model uncertainty) versions of the optimiza- 

tion problems in (i) and (ii), and we prove a relation between them. In particular, we 
show explicitly how to get from the solution of one of the problems to the solution of 

k>( ■ the other. 

;h ■ We illustrate the results with explicit examples. 
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1 Introduction 

The purpose of this paper is to use stochastic control theory to obtain new results and new 
proofs of important known results in mathematical finance, which have been proved using 
convex duality theory. 

The advantage with this approach is that it gives an explicit relation between the optimal 
scenario in the dual formulation and the optimal portfolio in the primal formulation. We 
now explain this in more detail. 

First, let us briefly recall the terminology and main results from the duality method in 
mathematical finance, as presented in e.g. 0: 

Let [/ : [0, oo] — )■ M be a given utility function, assumed to be strictly increasing, strictly 
concave, continuously differentiable (C^) and satisfying the Inada conditions: 

f/'(0) = lim U'{x) = cx) 

X— 5-0+ 

U'{oo) = lim U'{x) = 0. 

Let S{t) = S{t, u) ; <t <T, u & Q, represent the discounted unit price of a risky asset at 
time t in a financial market. We assume that S{t) is a semimartingale on a filtered probability 
space (fi, J^, {J-t}t>o, P)- Let Lp{t) be an J^j-predictable portfolio process, giving the number 
of units held of the risky asset at time t. If Lp{t) is self- financing, the corresponding wealth 
process X{t) = X^(t) is given by 

X{t)=x+ I (f{s)dS{s); 0<t<T, (1.1) 

Jo 

where T > is a fixed terminal time and x > is the initial value of the wealth. We say 
that Lp is admissible and write Lp & A ii the integral in (11. ip converges and 

X^{t) > for all t E [0, T], a.s.. (1.2) 

The classical optimal portfolio problem in finance is to find ip* E A (called an optimal 
portfolio) such that 

uix) := snp E[U{X;iT))] = E[^(X^.(T))]. (1.3) 

The duality approach to this problem is as follows: Let 

Viy) := sup{t/(x) - xy} ; y>0 (1.4) 

x>0 

be the convex dual of U. Then it is well-known that V is strictly convex, decreasing, C^ and 
satisfies 

V\0) = -oo, 1/'(oo) = 0, 1/(0) = f/(oo) and ^(oo) = U{0). (1.5) 



Moreover, 

U{x) = mi{V{y) + xy} ; x > 0, (1.6) 

y>0 

and 

U'{x) = y^x = -V\y). (1.7) 

Let Ai be the set of probability measures Q which are equivalent local martingale mea- 
sures (ELMM), in the sense that Q is equivalent to P and S{t) is a local martingale with 
respect to Q. We assume that A^ 7^ 0, which means absence of arbitrage opportunities on 
the financial market. The dual problem to (II. 3p is for given y > to find Q* E Ai (called 
an optimal scenario measure) such that 



v(y) := inf E 






E 






(1- 



One of the main results in [7] is that, under some conditions, Lp* and Q* both exist and 

they are related by 

dQ* 

dP 



U'iX;.iT)) = y^ withy = u'ix) (1.9) 



I.e. 



X;4T) = -V (^y^^ with X = -v'{y). (1.10) 

In this paper we will give a new proof of a result of this type by using stochastic control 
theory. We will work in the slightly more special market setting with a risky asset price S{t) 
described by an Ito-Levy process. This enables us to use the machinery of the maximum 
principle and backward stochastic differential equations (BSDE) driven by Brownian motion 
B{t) and a compensated Poisson random measure N{dt, dQ ; t > ; C ^ I^o •= IR\{0}. The 
advantage with this approach is that it gives explicit relation between the optimal scenario 
and the optimal portfolio. This is shown in Section [3] (see Theorem 13. ip . As a step on the 
way, we prove in Section [2] a result of independent interest, namely that the existence of an 
optimal scenario is equivalent to the replicability of a related T-claim. In Section H] we extend 
the discussion to robust (model uncertainty) optimal portfolio problems. More precisely, we 
formulate robust versions of the primal problem (II. 3p and of the dual problem (11.80 and we 
show explicitly how to get from the solution of one to the solution of the other. 

2 Optimal scenario and replicability 

We now specialize the setting described in Section [1] as follows: 

Suppose the financial market has a risk free asset with unit price So{t) = 1 for all t and 
a risky asset with price S{t) given by 

dS{t) = S{t-) (h{t)dt + a{t)dB{t) + f -f{t, C)N{dt, dC)] ; 0<t<T 

V Jr J (2.1) 

S{0) > 



where b(t), a{t) and ■y{t, () are predictable processes satisfying 7 > — 1 and 



E 



Uo 



\b{t)\ + a'it)+ j\t,CHdC)\dt 



< 00. 



(2.2) 



Here B{t) and N{dt,dQ := N{dt,d() — v{dQdt is a Brownian motion and an indepen- 
dent compensated Poisson random measure, respectively, on a filtered probability space 
{yt,J^,{Ft}t>o,P) satisfying the usual conditions, P is a reference probability measure and 
V is the Levy measure of N . In the following we assume that 



a{t) T^Ofor alltG [0,T]. 



(2.3) 



This is more because of convenience and notational simplicity than of necessity. See the 
remark after Theorem 12. 2[ Note that this assumption is not used before (I2.19p . 
Let ifi{t),A be as in Section [1], with the condition 



E 



^{tfS{tf h{tf + a\t) + / y (t, C)u{dC) dt 



< 00. 



Let X(t) = X^{t) be the corresponding wealth process given by 

jdX{t) = ip{t)S{t-) b{t)dt + (r{t)dB{t) + J^-f{t,ON{dt,dC) 
\x(0) = x>0. 



0<t<T 



(2.4) 



For Lp to be admissible we require moreover that we have, for some e > 



and 



E[[ \X{t)\^+'dt] <oo 
Jo 

E[U'{X{T))''^'] 



< 00. 



As in (II. 3p . for given x > 0, we want to find if* & A such that 



uix) 



snpE[U{X;{T))] = E[U{X;,{T))]. 



ipeA 



(2.5) 
(2.6) 
(2.7) 



In our model we represent A4 by the family of positive measures Q = Qg oi the form 

dQeiuj) = Ge{T)dP{io) on Jr, (2.^ 

where 

'dGeit) = Gein [eo{t)dB{t) + J^9,{tX)N{dt,dO^ _ _ ^ _ ^ 

G0{O) = y>O 



and 6' = (^0) ^i) is a predictable process satisfying the conditions 



E 
and 



\olit)+ / el{t,c)v{d()\dt 



< cx), 6*1(^,0 > -1 a.s. (2.10) 



b{t) + a{t)9o{t) + [ j{t,Oei{t,CHdO = 0; te[0,T]. (2.11) 

Jr 

li y = 1 this condition characterises Qg as an equivalent local martingale measure (ELMM) 
for this market. See e.g. [121 Chapter 1]. 

We let 6 denote the set of all J-f-predictable processes 6 = [Oq.Oi) satisfying the above 
conditions. 

Thus the dual problem corresponding to (II. 8p is for given y > to find 6* ^ Q and v{y) 

- v{y) := supE[-V{G^,{T))] = E[-V{GUT))]. (2.12) 

eee 

We will use the maximum principle for stochastic control to study the problem (I2.12p 
and relate it to (12. 7p . 

We first prove the following useful auxiliary result, which may be regarded as a special 
case of Proposition 4.4 in |1]. 

Proposition 2.1 Let (p{t) G A. Then (p{t) is optimal for the primal problem (12. 7p if and 
only if the (unique) solution {p, q, f) of the BSDE 



dp{t) = q{t)dB{t) + / f{t,C)N{dt,d() ; < t < T 
f{T) = t/'(X|(T)). 

satisfies the equation 



(2.13) 



b{t)p{t) + a{t)q{t) + / l{t,C)r{tXHdC)=0- t e [0,T]. (2.14) 

Jr 

Proof. (i) First assume that <^ G ^ is optimal for the primal problem (12. 7p . Then by the 
necessary maximum principle (Theorem IA.2p the corresponding Hamiltonian, given by 



H{t,x,ip,p,q,r) = ipS{t-){b{t)p + aq+ / j{t,Or{ON{dt,dO) (2.15) 

Jr 

satisfies 

— {t,x,^,p{t),q{t),r{t,-)) \^=^(t)= 0, 

where {p,q,r) satisfies (I2.13p . This implies (I2.14p . 



(ii) Conversely, suppose the solution {p,q,r) of the BSDE f l2.13p satisfies fl2.14p . Then 
ifi, with the associated {p, q, r) satisfies the conditions for the sufficient maximum principle 
(Theorem lA.ip and hence (f is optimal. D 

We now turn to the dual problem (12 .12^ . The Hamiltonian H associated to (I2.12p is, by 



H{t,g,9o,9^,p,q,r) = geoq + g / ei{Or{()iy{d(). (2.16) 

Jm. 

(We refer to e.g. [1^ for more information about the maximum principle). 

The adjoint equation for (p, g, r) is the following backward stochastic differential equation 
(BSDE): 

dp{t) = -^-{t,Ge{t),9o{t),e,{t,-),p{t),q{t),r{t,-))dt 



dg 

+q{t)dB{t) + / r{t,C)N{dt,dC) ; < t < T 

^p{T) = -V'{Ge{T)). 
In our setting this equation becomes 

dp{t) = 



dt 



UtHt)+ / eiitXWXMdO 

JR 

+q{t)dB{t) + / r{t,C)N{dt,dC) ; 0<t<T 

/ire 

[p{T) = -V'{Ge{T)). 
By (12. 3p the constraint (12. lip can be written 

1 



Oo{t) = 9o{t) 



ait) 



m 



7{t,O0i{t,CHdO> ; te[o,T]. 



Substituting this into (I2.16P we get 

Hi{t,g,9i,p,q,r) := H{t,g,eo,9i,p,q,r) 



a{t) 



6(t)+ / jitx)0iiCHdO 



OiiOriCHdC) 



and this gives 



dp{t) 



Qit) 



a{t) 

+ I r{t,oei{t,cHdO 



b{t)+ I ^{tx)0i{t,CMdO 

R 

dt 



+q{t)dB{t) + / r{t,C)N{dt,dC) ; 0<t<T 
[p{T) = -V\Ge{T)) 



(2.17) 



(2.18) 



(2.19) 



(2.20) 



I.e. 



dp{t) 



^b{t) + [ e,{t, c) (^Mt, - r{t, c) ) HdC) 



dt 



+q{t)dB{t) + / r{t,C)N{dt,dC) ; 0<t<T 
[p{T) = -V'iGeiT)). 
If there exists a maximiser 9i for Hi then 

(Ve,//i),^=,-^ = 0, 



(2.21) 



I.e. 



ait) 



7(t,C)+r(t,C) = 0; 0<t<T. 



(2.22) 
(2.23) 



Substituting this into (12.211) we get 
<i{t) 



dp{t) 



a{t) 
^p{T) = -V'iGeiT)) 



b{t)dt + a{t)dB{t) + / -f{t,C)N{dt,dC) 



0<t<T 



(2.24) 



Equation (I2.24p states that the contingent claim F := —V'{Gg{T)) is rephcable, with 
rephcating portfoho ip{t) given by 



ifit) :-- 



Qit) 



; tE[0,T]. 



(2.25) 



a{t)S{t- 

and initial value x = p{0). We have proved (i) =^ (ii) in the following theorem: 
Theorem 2.2 The following are equivalent: 
(i) For given y > 0, there exists 9 E Q such that 

snp E[-V{Gy{T))] = E[-V{Gl{T))] < oo. 

(ii) For given y > 0, there exists 9 & Q such that the claim F := —V'{G^~(T)) is replicable, 
with initial value x = p{0), where p solves (12.241) . 



Moreover, if (i) or (ii) holds, then 



^{t) :-- 



m 



a{t)S{t- 



(2.26) 



is a replicating portfolio for F := —V'{G^JT)), where {p(t),q{t),f(tX)) is the solution of the 
linear BSDE 



dp{t) = ^h{t)dt + q{t)dB{t) + / f(t, ON{dt, dC); 0<t<T 
a{t) 

p{T) = -V'iGUT)). 



(2.27) 



Proof. It remains to prove that (ii) =^ (i): Suppose that (6*0,^1) G is such that F : = 
—V'{Gq(T)) is rephcable with initial value x = p{0), and let ip E Ahe a. replicating portfolio. 
Then X{t) = X^{t) satisfies the equation 



h{t)dt + a{t)dB{t) + / -f{tX)N{dt,dC) 



0<t<T 



dX{t) = ipit)S{t 
X{T) = -V'{Ge{T)). 

Define 

Pit) := X{t)A{t) := ipit)a{t)Sit-) and f(t,C) := ^{t)j{tX)Sit 

Then by ([22HD, ip,q,r) satisfies the BSDE 



dp{t) 



m 



a{t) 
^p{T) = -V'{G^{T)), 



h{t)dt + q{t)dB{t) + / f(t, C)N{dt, dQ ] 0<t<T 



(2.28) 



(2.29) 



(2.30) 



and p(0) = X{0) = x = p(0). Since (^0, ^1) G 6 we get by f ETT]) and flZ^ that fl^:^]]) can 
be written 



dpit) 



dt 



(2.31) 



e,{t)m+ / ^i(t,C)r(t,C)K^C) 

+q{t)dB{t) + / r{t,C)N{dt,dC) ; 0<t<T 
[p{T) = -V'{G^{T)). 

Comparing with (I2.18P we see that this is the BSDE for the adjoint equation corresponding 
to the stochastic control problem (I2.12J1 . Therefore, since the functions g — )■ —V{g) and 

g -^snpHi{t,g,ei,p{t),q{t),r{t,-)) = -9^b{t) 
ei cr(t) 

are concave, it follows from the sufficient maximum principle that (^Oi ^1) is optimal for the 
problem (I2.12p . Hence (i) holds. 



The last statement follows from fl2:24|) and (12:251) . 



n 



Remark 2.3 So far we have assumed that (12.31) holds. This is convenient, because it allows 
us to rewrite the constraint (12. lip in the form (I2.19p . If we do not assume (12. 3p . then we 
can use the Lagrange multiplier method in stead, as follows: 
Let A(t) be the Lagrange multiplier process and consider 



(2.32) 



i/i(^o,^i,A) ■.= ge,q + g / er{Or{Qu{dQ 

Jm. 

+ A(t) (bit) + a{t)eo + / -fit, OOiiCHdC) 



Maximising Hi over all 9q and 6i gives the following first order conditions 

gq + Xit)a{t) = 

^r(-) + A(t)7(t,-)=0. 
Since g = Geif) ^ 0, we can write these as follows: 



Ge{t) 



Substituting this into (12.181) we get 



dp{t) 



A(t) 



MtMt) 



Ge{t) 
+a{t)dB{t) + J^-f{t,ON{dt,dO 

[p{T) =-V\Ge{T)). 
In view of (12.111) this can be written 

m 



ei{txh{tXHdO}dt 

0<t<T 



dp{t) = -- 



Ge{t) 
^p{T) = -V\Ge{T)) 



h{t)dt + a{t)dB{t) + / j{t,C)N{dt,dC) 



0<t<T 



Note that 



If a(t) 7^ then 
If 7(t, ^ then 



m qit) 



Ge{t) ait) 
m r(t,C) 



Geit) 7(t,C) 

If a{t) = -fit, C) = 0, then by (l235ll and ^M> we have q{t) = r{t, () = and 
(I2.18P we have dp{t) = 0. Therefore we can summarize the above as follows: 
Define 

-X<T(t)^o H /, AN c/^-\ ^^ft)=o.7(t.C)7^o- 



(2.33) 
(2.34) 

(2.35) 
(2.36) 



(2.37) 



ifit) 



a{t)S{t- 



i{tX)S{t- 



(2.38) 

(2.39) 

(2.40) 
hence by 

(2.41) 



Then by ( 1238|) 



dp{t) = ^{t)S{t~ 



b{t)dt + a{t)dB{t) + / -i{tX)N{dt,dQ 



■ 0<t<T 



^p{T) = -V'{Ge{T)). 



(2.42) 



Therefore —V'{Ge{T)) is replicable, with replicating portfolio Lp{t) given by (12.41 p . 

Thus we see that Theorem 12.21 still holds without assumption (12. 4p . if we replace (I2.26P 
bydMH). 



9 



3 Optimal scenario and optimal portfolio 

We proceed to show that the method above actually gives an explicit connection between an 
optimal ^ G for problem fl2.12p and an optimal portfolio (p & A for problem (12. 7p : 

Theorem 3.1 a) Suppose if E A is optimal for problem i \2.7\i with initial value x. Let 
{pi{t),qi{t),ri{t,()) be the solution of the BSDE 

■\ KT(ri+ ri/^\ ■ n ^ + ^ T" 

(3.1) 



dpi{t) = qi{t)dB{t) + / ri(t, C)N{dt, dQ ; 0<t<T 
^T) = f/'(X|(T)). 



Define 
Suppose 



^»<"^iy' ^■<«'^^- '-' 



E[ [ {Olit) + [ efit, CHdO}dt] < oo; e,> -1. (3.3) 

Jo Jm. 

Then 9 = {6o,0i) G 9 is optimal for problem (12.121) with initial value y = pi{0) and 

G]{T) = U'{Xl{T)). (3.4) 

b) Conversely, suppose 9 = {6o,0i) G zs optimal for problem (I2.12p with initial value y. 
Let {p{t),q{t),r{t,()) be the solution of the BSDE 

dpit) = ^h{t)dt + q{t)dB{t) + / r(t, ON{dt, dO;0<t<T 

^{t) Jr (3.5) 

^p{T) = -V'iGliT)). 
Suppose the portfolio 

m ■■= -7W§-T ■,0<t<T (3.6) 

a{t)S{t ) 

is admissible. Then (p is an optimal portfolio for problem (12. 7p with initial value x = p{0) 
and 

mT) = -V'{Gl{T)). (3.7) 

D 

Proof. 

a) Suppose ip is optimal for problem (12. 7p with initial value x. Then the adjoint processes 

Pi(t),Qi(t),ri(t,C) for problem ([22D satisfy both the BSDE 

dpi{t) = qi{t)dB{t) + / ri(t, ON{dt, dC) ; < t < T 

Jr (3.0J 

MT) = U'iXliT)) 

10 



and the equation (see [H Proposition 4.4]) 



bit)p,{t) + a{t)q,{t) + / 7(t,C)ri(t,C)KrfC) = 0. 



Define 



W--=^^, Oiitx) 



pi{t-) 

Then (6*0,^1) G 9 and (13.11) can be written 



ri(t,C) 
Piit-) ' 



(3.9) 



(3.10) 



dpiit) =pi{r 



eo{t)dB{t)+ / ei{t,C)N{dt,dC) 



(3.11) 



Therefore Ggit) := piif) satisfies the equation (12.91) with initial value y = pi(0) > and we 
have that, by (II. 7p 



/7'(X|(T)) = GUT), i.e. X|(T) = -V'{GUT)). 



(3.12) 



Therefore — y(G^(T)) is replicable and by Theorem 12.21 we conclude that 9 := 9 is optimal 
for problem (I2.12| . 

b) Suppose ^ G O is optimal for problem (I2.12p with initial value y. Let p{t),q{t),r{t, ■) be 
the associated adjoint processes, solution of the BSDE (13. 5p . Then by (I2.24p . they satisfy 
the equation 



dp{t) 



Qit) 



ait) 
^piT) = -V'iG^iT)) 



b{t)dt + a{t)dB{t) + / -f{t, C)N{dt, dQ 



Define 



Then 



m ■■-- 



m 



a{t)S{t- 



X^iT) = -V\G]{T)) i.e. G]{T) = t/'(X|(T)), 
with X = p(0). Therefore G^t) = Gg{t) satisfies the equation 



(3.13) 

(3.14) 
(3.15) 



dG^it) = G^it- 



9o{t)dB{t)+ / 9i{tX)N{dt,dC) 



<t<T 



G^(T) = [/'(X|(T)). 



Define 



Po{t) := G^(t),go(t) := G,-(t)^o(t), ro(t, C) := G'^(t)^i(t, C). 



(3.16) 



(3.17) 



11 



Then by ( I3.16P {po, qo,rQ) solves the BSDE 



< 



'dpoit) = qo{t)dB{t) + / ro(t,C)iV(rft,rfC) ; < t < T 



{p,{T) = [/'(X|(r)). 
Moreover, since ^ G we have, by (12. lip 

b{t) + (r{t)eo{t) + [ 7(t, CWiit, CMdO = 0;0 <t<T (3.19) 

i.e., {po,qo,rQ) satisfies the equation 

m + ^(t)^ + / 7(t, cf-^^'yidC) = ; < t < T. (3.20) 

It follows from Proposition 12.11 that c^ := (^ is an optimal portfolio for problem (12. 7p with 
initial value x = p{0). D 



Example 3.1 As an illustration of Theorem 13.11 let us apply it to the situation when there 
are no jumps (A^ = 0). Then 6 has just one element 9 given by 

a{t) 
So for any given y > 0, ^ is optimal for the problem (12.120 . and 

G,(r)^,exp(-£M,BW-i/'g£|.,). (3.21) 

Then, by Therem l3.1b ). if {p, q) is the solution of the BSDE 

dpit) = ^Kt)dt + q{t)dB{t) ;0<t<T ^^ ^^^ 

XT) = -V'{Gs{T)), 

then ip{t) := is an optimal portfolio for the problem 

a{t)S{t ) 



snp E[U{X^{T))] 



with initial value x = p{0). 



12 



In particular, if U{x) = \nx, then V{y) = —\ny — 1 and V'{y) = — . So the BSDE 
( I3.22p becomes 



dp{t) = ^h{t)dt + q{t)dB{t) ■ 0<t<T 



ait) 



p(T) = — exp 

y \Jo ^is] 



T 



bis) 



dBis) + 



T u2 



b\s) 

2 7o <^'is: 



ds 



(3.23) 



To solve this equation we try 



q{t) = Pit) 



m 

ait)- 



Then 



which has the solution 



dpit) = Pit) 



a^it) ait) 



Pit) = piO) exp ( f ^^dBis) + 1 f ^ds) ; < t < T. 
\Jo ^(s) 2 Jo a^is) J 

Hence f l3.23p holds and we conclude that the optimal portfolio is 

for the primal problem with initial value x = -. Note that with this portfolio we get 

hit) 



(3.24) 
(3.25) 

(3.26) 



(3.27) 



dX^it) = pit)^-^[bit)dt + ait)dBit)] 
a\t) 



Pit) 



Therefore 



a^it) ait) 

bit) 



dpit). 



m = Mt)- 



^' V2(t)5(t-) 

which means that the optimal fraction of wealth to be placed in the risky asset is 

msit-) bit) 

''^' X^it) a^ty 
which agrees with the classical result of Merton. 



(3.28) 



(3.29) 



(3.30) 
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4 Robust duality 



4.1 The robust primal problem 

In this section we extend our study to a robust optimal portfolio problem and its dual. Thus 
we replace the price process S{t) in (12.11) by the perturbed process 



dS^{t) = S^{t-)[{b{t) + ^{t)a{t))dt + a{t)dB{t) + / 7(t, ON{dt, dQ] ; 0<t<T 

Jr 
S^{0) > 0, 

for some perturbation process /i(t), assumed to be predictable and satisfy 



(4.1) 



E 



\fM{t)a{t)\dt 



< oo. 



We let A^ denote this set of perturbation processes fj,. 
Let A denote the set of portfolios Lp{t) such that 



E 



v{tfS,{tf {h{t) + ^{t)a{t)f + a\t) + / f (t, C)v{dC) dt 



< CXD, 



X^,^(t) > for all t e [0,T] a.s. , 
(12. Sp . and (12.51) . where X{t) = X^^^^it) is the wealth corresponding to tp and //, i.e. 



(4.2) 
(4.3) 



jdX{t) = ip{t)S^it-)[{b{t) + fi{t)a{t))dt + a{t)dB{t) + / 7(t, C)iV(rft, dQ] 
[X{0) =x>0. 



0<t<T 



Let p : M — 7- R be a convex penalty function, assumed to be C^. 
Definition 4.1 The robust primal problem is to find [tp, fi) E A x Ai such that 



(4.4) 



inf sup /((/?, /i) = 1(0, fi) = sup inf I{{p,fi), 



where 



1(^,1^) = E 
where U is as in SectionUi 



U{X^AT)) 



p{ll{t))dt 



(4.5) 
(4.6) 



The problem (14.51) is a stochastic differential game. To handle this, we use an extension of 
the maximum principle to games, as presented in e.g. [TB]. Define the Hamiltonian by 



Hi{t,x,(p,fi,pi,qi,ri) = p{p) + ifS^{t ) 



{b{t) + fia{t))pi + a{t)qi 



^{t,On{CHdC) 

(4;?) 
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The associated BSDE for the adjoint processes {pi,qi,ri) is 

dpi{t) = —^{t,X{t),y^{t),^i{t),p,{t),q,{t),n{t))dt 



+qi{t)dB{t) + / ri(tX)N{dt,dC) ■,0<t<T 
[p^{T) = U\X^^,{T)). 



Since ^^ = 0, this reduces to 



dpi{t) = qi{t)dB{t) + J^n{tX)N{dt,dO ; 0<t<T 
p,(T) = U\X^,,{T)). 



{Al 



The first order conditions for a maximum point (^ and a minimum point /i, respectively, for 
the Hamiltonian are 



(&(t) +/i(t)a(t))pi(t) + a(t)5i(t) + / 7(t,C)ri(t,C)z^(rfC) = ; t G [0,T] (4.9) 

p'im) + mSf.{t-Mt)pi{t) = ; t G [0,r]. (4.10) 

Since Hi is concave with respect to ip and convex with respect to /i, these first order conditions 
are also sufficient for ip and ft to he a. maximum point and a minimum point, respectively. 
Therefore we obtain the following characterization of a solution (saddle point) of (14. 5p : 

Theorem 4.2 (Robust primal problem) A pair {0,fi) & A x Ai is a solution of the robust 
primal problem (14. 5 P if and only if the solution {pi, qi,ri) of the BSDE 

dpi{t) = qi{t)dB{t) + f riit,C)N{dt,dC); 0<t<T 
^Pi(T) = ^'(X^,^(T)). 

satisfies dM]), KW . 

Alternatively, we can formulate this as follows: 

{ip,fi) = {if, fi) & A X J\A is optimal for (14. 5 P if and only if the solution {pi,qi,ri) of the 
FBSDE dilD and (gSD satisfies (HlQjl - fHrTOj) . 

4.2 The robust dual problem 

It is not a priori clear what should be a dual formulation of the robust primal problem in 
subsection 14.11 One formulation is studied in [5]. Here we will choose a different duality 
model, as follows: 
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Definition 4.3 The robust dual problem is to find 9 E Q, i-i E Ai such that 



sup sup J{9, jj) = J{9, ji) = sup sup J{9, /i) 



where 



and V is the convex dual of U , as in Section [11 
Here Ge{t) = Gg^^,(t) is given by 



-ViGg{T)) - I p{f^it))dt 





(4.12) 



(4.13) 



9o{t)dB{t)+ / 9i{t,C)N{dt,dC) 



dGe{t) = Ge{t 
GeiO) = y>0 

with the constraint that ii y = 1, then the measure Qg defined by 

dQg = Gg{T)dP on Jt 



< t < T 



(4.14) 



is an ELMM for the perturbed price process S^{t) in (14. ip . By the Girsanov theorem for 
Ito-Levy processes [12] this is equivalent to requiring that (^oi ^i) satisfies the equation 

5(t) + /i(t)a(t) + a(t)^o(t)+ [ -f{tX)di{tXMdO = 0; tG[0,T]. (4.15) 



Substituting 



Oo{t) 



a{t) 



6(t) + /i(t)a(t)+ / j{t,09,it,CHd,0 



(4.16) 



into fj4T4l) we get 



^ dGe{t) = Ggit-) ^ ^ 



b{t) + fi{t)a{t) + / 7(t,C)^i(t,C)K^C) 



ait) 
9i{t,C)N{dt,dC)j ; 0<t<T 

[GeiQ)=y>0. 
The Hamiltonian for the problem (I4.12p then becomes 

9(l2 



dB{t) 



(4.17) 



H2{t,g,9i,fi,p2,q2,r2) = -p{^i) 



ait) 
+ g I 0,{Or2{C)HdC)- 



b(t)+^a{t)+ / 7(t,C)^i(C)KO 



(4.18) 
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The BSDE for the adjoint processes {p2, (12,^2) is 
dp2{t) - ' 



9^{t,0r^{tXHd(:)]dt 



(4.19) 



+q2{t)dB{t) + / r2{tX)N{dt,dQ ; < t < T 

/ttj 

[P2(T) = -r(G,(r)). 

The first order conditions for a maximum point (^, /i) for H2 are 

g2(t) 






a{t) 



(4.20) 
(4.21) 



Substituting fH:20D into fl4:T9|) we get 



dp2{t) = ^m + fiitMt)]dt 
a{t) 

+q2{t)dB{t) + / r2(t, C)iV(dt, rfC) ; ^ e [0, T] (4-22) 

[P2(r) = -F'(G,-(T)). 

Therefore we get the following. 

Theorem 4.4 (Robust dual problem) A pair (6',/i) G x A^ is a solution of the robust 
dual problem (I4.12l) - (l4.13p if and only the solution {p2, q2, ^"2) of the BSDE (14.221) also satisfies 

Alternatively, we can formulate this as follows: 

{6,jl) eQ X Ai is optimal for (I4.12l) - (l4.13p if and only if the solution {p2,q2,T^2) of the 
FBSDE dHT]) & KT2\> satisfies (^M-<SM- 

4.3 From robust primal to robust dual 

We now use the characterizations above of the solutions [0, p.) E Ax Ai and {9,fi)EQxAi 
of the robust primal and the robust dual problem, respectively, to find the relations between 
them. 

First, assume that {0,fi) G ^ x A^ is a solution of the robust primal problem and let 
(pi, gi, ri) be as in Theorem 14.21 i.e. assume that {pi, qi, ri) solves the FBSDE (14. 4p & (14. lip 
and satisfies (ra- lgrTOll . 
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We want to find the solution (^, /2) G x A^ of tlie robust dual problem. By Theorem 
14.41 this means that we must find a solution {p2, q2,'>^2) of the FBSDE (14.171) & fl4.22p which 
satisfies (gSHD-dlSID. 

To this end, choose 

fi:= fi (4.23) 

and define 



Oo{t) 



Plit) 



and 9i{tX) ■-- 



Plit) 



Then by (14.91) we have 



b{t) + /i(t)a(t) + a(t)^o(t) + / lit, C)^i(t, CHdO = 



Assume that (IZTOj) holds. Then 9 e Q. 
Substituting (I4.24p into fli^ . we obtain 



dPiit) =Piit ) 
Comparing with (I4.14p we see that 



eoit)dB{t)+ / eiit,c)N{dt,dC) 



te[0,T] 



dGgit) dpi{t) 



Geit) Plit) 
and hence, for y = Gq{0) = pi(0) > we have 

p,{t) = G^{t); te[0,T]. 



In particular. 
Define 



f/'(X^,^(T)) = G,-(T). 



P2(t) :=X^,^(t),g2(t) ■.= 0it)a{t)S^{t-),r2it,C) := 0it)i{t,C)S^{t-). 
Then by (glD and (g^H]), combined with fiLTI) . 



dp2it) = 0it)S^it 
Q2it) 



{b{t) + il{t)a{t))dt + a{t)dB{t) + / i{t,C)N{dt,dC) 

Jr 

[b{t) + jj{t)a{t)]dt + q2it)dB{t) + / r2(t, C)iV(dt, c^C) ; < t < T 



a(t) 
tp2(T) = X^,^(r) = -y'(G,-(T)). 

Hence (^2,92,^2) solves the BSDE (I4.22p . as requested. 



(4.24) 



(4.25) 



(4.26) 



(4.27) 
(4.28) 

(4.29) 



(4.30) 



It remains to verify that fl4.20p and (14.211) hold: By fl4.29p we have 
92 (t) 



a{t) 



.7(t, + r2{t, = -ms,{t-Ht, c) + ms,{t-h{t, = o, 



which is iK20\\ . 

By g;23D, (|MID> <SM and glOD, 



p'(/i) + G^it)q2it) = p\fi)+p^m(t)a{t)S{r) = 0, 



which is g2I]). 

We have thus proved the theorem: 

Theorem 4.5 Assume {0,fi) & A x Ai is a solution of the robust primal problem and let 
(pi,gi,ri) be the associated adjoint processes satisfying (14. lip . Define 



^ :=/i 



Pl{t) 



Plit) 



(4.31) 
(4.32) 



and suppose they satisfy (I2.10p . Then, they are optimal for the dual problem with initial 
value y = pi(0). 



4.4 From robust dual to robust primal 



Next, assume that (6', /i) G 6 x A^ is optimal for the robust dual problem (I4.12p - P?T3|) and 
let {p2, (12,1^2) be as in Theorem 14. 4[ 

We will find {0, fi) E A x JH and {pi,qi,ri) satisfying Theorem 14.21 Choose 



and define 



0{t) :-- 



q2it) 



a{t)S^it- 
Assume that (p is admissible. Then by (KT2\i and fH^ 



te[o,T]. 



dp2{t) = 0{t)S^{t 

[P2{T) = -V'{G~,{T)). 
Hence 



{b{t) + fi{t)a{t))dt + a{t)dB{t)+ / j{t,C)N{dt,dC) 



dp2{t) = dX^^j^{t) 



and we obtain that, for x = ^2(0) > 0, 



P2{T) = X^,^(T). 



(4.33) 
(4.34) 



< t < T 



(4.35) 
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Therefore, 

X^^f^iT) = -V'iG^iT)), i.e. G,-(r) = f/'(X^,^(T)). 

We now verify that with (f = Lp, fi = fi, and pi,qi, ri defined by 

pi(t) := G',-(t),gi(t) := G,-(t)^o(t), ri(t, C) := G',-(t)0~i(t, C). 
all the conditions of Theorem 112] hold: By (gTTll and fl436D . 

1 



(4.36) 
(4.37) 



dpi{t) = dGg{t) = Gg{t- 



ei{t,C)N{dt,dC)j ; 0<t<T 
tpi(r) = G,-(T) = f/'(X^,^(r)). 



a{t) 



6(t)+/i(t)a(t)+ / ^{t,oe,{txMdO 



dB{t) 



(4.38) 



Hence KT\\ holds. 

It remains to verify ^Mj and (lirTOll . By (J437]) and (l4J5|) for 9 = 9, we get 

(6(t) + /i(t)a(t))pi(t) + a(t)gi(t) + / 7(t, C)ri(t, C)z/(rfC) 



Goit) 



bit) + /i(t)(T(t) + ait)9o{t) + / 7(t, C)^~i(t, CHdC) 



which is (I4l9!) . 

By (14:331) . ^14^471) . (H:371) and (gJl]) we get 



p'im) + 0{t)S,{t-)a{t)p,{t) = p\m) + q2{t)G~,{t) = 0, 



which is (I410|) . 

We have thus proved the theorem 

Theorem 4.6 Lei^ (^, /i) G O x A^ 6e optimal for the robust dual problem and let {p2, q2, ^2) 
be the associated adjoint processes satisfying (I4.22p . Define 



H := H 



^t 



q2{t) 



te[o,T]. 



(4.39) 
(4.40) 



crtSf,{t- 
Assume that ip E A. Then (/i, ift) are optimal for primal problem with initial value x = J02(0). 

Remark 4-7 Note that the optimal adjoint process pi for the robust primal problem coin- 
cides with the optimal density process Gg for the robust dual problem. 

Similarly, the optimal adjoint process p2 for the robust dual problem coincides with the 
optimal state process X^ for the robust primal problem. 
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Example 4.1 We consider a robust version of Example 13. 1[ We want to study the robust 
primal problem 



inf sup E 



U{X^,,{T)) + / p{^{t))dt 



(4.41) 



in the case with no jumps (A^ = 7 = 0). In this case there is only one ELMM for the price 
process S^{t) for each given /i(t). So the corresponding robust dual problem simplifies to a 
plain stochastic control problem 



sup E 



-V{G, 



.XT)) - [ p{fi{t))dt 
Jo 



where 



dG^,{t) = -G^{t-)[- + p{t)]dBt ; < t < T 
G^{0) = y>0. 
The first order conditions for the Hamiltonian reduces to: 

m = {pr\-G,{t)q{t)) 

which substituted into the adjoint BSDE equation gives: 



(4.42) 



(4.43) 



(4.44) 



dp{t) = 9(t)[^ + {p')-\-G^{t)q{t))]dt + q{t)dB,- ; t G [0,T] 
^p{T) = ~V'{G~,{T)). 



(4.45) 



We get that /i is optimal for the robust dual problem if and only if there is a solution (p, g, G^) 
of the FBSDE consisting of fH^lSl) and 



dG-^{t) = -G~^{t-)[^ + m]dBt ■,0<t<T 



G^(0) = y>0 



CTt 



(4.46) 



Hence , the optimal fi for the primal robust problem is given by /i := /i, and the optimal 
portfolio is 



vt 



(^tSf^{t- 



te[0,T]. 



(4.47) 



We have proved: 



Theorem 4.8 The solution /i, of the robust primal problem (I4.4ip is given by (I4.44p and 
(I4.47p . respectively, where {Gf^^p^q) is the solution of the FBSDE 04.46p - (l4.45p . 



21 



A Maximum principles for optimal control 

Consider the following controlled stochastic differential equation 

dX{t) = b{t, X{t),u{t),u)dt + a(t, X{t),u{t),u)dB{t) (A.l^ 

+ / -f{t,X{t),u{t),uj,C)N{dt,dC) ; 0<t<T 
X{0) = xeR 

The performance functional is given by 



J{u) = E 



f{t,X{t),u{t),oj)dt + ^{X{T),co) 



(A.2) 



where T > and w is in a given family A of admissible J-'-predictable controls. For u ^ A 
we let X"(t) be the solution of f lA.ip . We assume this solution exists, is unique and satisfies, 
for some e > 0, 

E[f |X"(t)|2+^rft] <oo. (A.3) 

Jo 

We want to find u* ^ A such that 

sup J{u) = J (u*). (A.4) 

We make the following assumptions 

f eC^ and E[ f \VfWt)dt\ < oo, (A.5) 

Jo 

b,a,-feC' and E[f {\Vb\^ + \V a]'' + \\Vjf)it)dt] < oo, (A.6) 

Jo 

where II V7(t,-)f:= [ ^'{tXHdO 
4>eC^ and for all u e A, 3e s.t. E[(t>'{X{T)f+'] < oo. (A.7) 

Let U be a convex closed set containing all possible control values u{t); t G [0, T]. 
The Hamiltonian associated to the problem (1A.4P is defined by 

H : [0,T] X R X V X R X R X TZ X n h^ R 
H{t,x,u,p,q, r,u) = /(t, x,u,u) + b{t, x,u,u)p + a{t,x, u,u)q+ / 'y{t,x, uX,^)r{t, ()iy{d(). 



For simplicity of notation the dependence on u is suppressed in the following. We assume 
that H is Frechet differentiable in the variables x, u. We let m denote the Lebesgue measure 

on [o,r]. 
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The associated BSDE for the adjoint processes {p, q, r) is 

dp{t) = - — (t) + q{t)dB{t) + / r{t, ON{dt, dQ ; < t < T 
< ox Jk lA.aj 

^piT) = cP'iXiT)). 

Here and in the following we are using the abbreviated notation 

BM f) 

{t) = —{t,X{t),u{t)) etc 
ox ox 

We first formulate a sufficient maximum principle, with weaker conditions than in [T3] . 

Theorem A.l ( Sufficient maximum principle) Let u E A with corresponding solutions 
X, p,q,r of equations l\A.l\} - l\A.8\} . Assume the following. ■ 

• The function x h-)- (fi{x) is concave 

• (The Arrow condition) The function 

H{x) := sup H{t, x,v,p{t), q{t),f{t, ■)) (A.9) 

is concave for all t G [0, T]. 



snpH{t, X{t),v,p{t),q{t),r{t, ■)) = H{t, X (t) , u{t) , p{t) , q{t).r{t, ■))■ t G [0, T]. 

vev 

(A.IO) 



Then u is an optimal control for the problem (]A.4|) . 



Next, we state a necessary maximum principle. For this, we need the following assump- 
tions: 

• For all to £ [0, T] and all bounded J-ig -measurable random variables a{uj) the control 

P{i) ■= X[to,T]{t)a{u) 
belongs to A. 

• For all u, (3 E A with /3 bounded, there exists 5 > such that the control 

u{t) := u{t) + aP{ty, te [0,T] 
belongs to A for all a E {—S, 6). 
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The derivative process 

exists and belongs to L'^{dm x dP), and 

dx{t) = {^{t)x{t) + ^(t)m}dt + {^{t)x{t) + |^(t)/3(t)}rfS(t) 

+ /{^(t, cMt) + ^{t, omwdt, do (A.ii) 

^x(O) =0 

Theorem A. 2 (Necessary maximum principle) The following are equivalent 

m 

-—J(u + a/3) \a=o= for all bounded /3 E A 
da 

m 

__(t) = Ofor allte [0,T]. 
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